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TITLE OF THE INVENTION 

METHOD OF DESCREENING SCREENED IMAGE, METHOD OF 
SEPARATING SCREENED IMAGE INTO REGIONS, IMAGE PROCESSING 
DEVICE, AND PROGRAM 

5 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to an image processing technique for processing 
digital images and, more particularly, to a technique for separating a screened image in 
10 the form of binary data into a first region from which a gradation area is to be derived and 
a second region from which a monotone area is to be derived, to selectively convert the 
first region into a multi-level gradation image. 

Description of the Background Art 

15 In a printing company and the like, there are cases where output using screened 

image data (with a resolution of, e.g., 2400 dpi) involves a need to change the screen 
ruling thereof or to readjust the dot gain thereof, depending on printing machines to be 
used. There are other cases where a change in color or tone of part of a picture image is 
requested for output reusing the screened image data stocked or stored after use. In 

20 these cases, it is possible to create desired screened image data again by performing a RIP 
process on image data (layout data) described, e.g., in PDF (Portable Document Format) 
from which the screened image data is generated. This technique, however, is 
disadvantageous in increased costs and increased processing time. 

To overcome the disadvantage, another technique has been conventionally 

25 attempted which includes the steps of performing a descreening process for re-creating 
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layout data directly from screened image data without the need to go back to the RIP 
process, making a desired correction, and then performing a screening process for 
generating screened image data again. 

Specifically, the descreening process refers to the process of re-creating layout 
5 data with a resolution of about 300 to 400 dpi and having multi-level gradation mainly 
from a picture image portion of screened image data which is binary image data with a 
resolution (output resolution) of about 2400 to 4000 dpi. 

In general, a picture image (including photographs and patterns) having 
multi-level gradation and a monotone character/line having no gradation are mixed on 

10 printed material. A screened image accordingly includes two types of regions: a first 
region from which a gradation area on the printed material is to be derived, and a second 
region from which a monotone area on the printed material is to be derived. In the first 
region, halftone dots are formed after the RIP process, i.e., the screening process. On 
the other hand, it is essentially unnecessary to perform the descreening process on the 

15 second region because the layout of binary data with a resolution as high as the output 
resolution is done in the step of generating the layout data. Thus, the screened image 
including both of the first and second regions, for example, in which a character/line is 
drawn on a picture is constructed to contain the first region in which halftone dots are 
arranged with predetermined regularity, and the character/line overlaid on the first region 

20 independently of the arrangement. It is therefore desirable that the descreening process 
is performed only on the first region after the first region and the second region in the 
screened image data are precisely separated from each other. 

The technique of precisely separating the first region and the second region is 
also required, for example, when it is desired to extract only character information from 

25 the screened image. 
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There are already known such techniques for separating the first region and the 
second region in the screened image data. For example, Japanese Patent Application 
Laid-Open No. 2002-252756 discloses the technique of judging whether or not a recorder 
grid of interest belongs to the first region, depending on whether or not the sum of the 
5 differences between the gradation level of the recorder grid of interest and the gradation 
levels of four recorder grids adjacent thereto satisfies a predetermined reference value for 
judgment. 

Simple conversion of the resolution is accomplished by uniformly performing a 
weighted averaging process on the screened image. This, however, presents the problem 

10 of degraded image quality, such as a generally blurred resultant image as compared with 
the original layout data or change in color. To solve the problem, studies have been 
conducted on the technique of performing the descreening process more accurately by 
giving consideration to the shapes of individual halftone dots. This technique is 
disclosed, for example, in Japanese Patent Application Laid-Open No. 2000-224415. 

15 The high-accuracy descreening process is the process of precisely separating 

only the first region of interest from other regions to precisely reproduce a multi-level 
gradation image yet to be RIP-processed from the separated first region. 
Accomplishment of the process allows the re-creation of screened image data subjected to 
desired correction and the like without the degradation of image quality. 

20 The use of the method of separating the first region and the second region from 

each other which is disclosed, for example, in Japanese Patent Application Laid-Open No. 
2002-252756 will succeed in somewhat rough separation. This method, however, finds 
difficulty in separating a character/line overlaid on a picture image from the picture image 
precisely at the output resolution level (about 2400 dpi or higher). An example of this 

25 method is shown in Fig. 15. Referring to Fig. 15, the second region CR2 is shown as 



overlaid on the first region SRI. Conventionally, the second region CR2 might become 
greater in area by the amount of a region BRl or smaller by the amount of a region BR2 
with respect to a true boundary in a boundary region BR. This causes the layout data 
obtained by the separation process and the subsequent descreening process to present the 
5 problems that the character/line overlaid on the first region SRI is unsharp or unnatural 
and that different separation processes are performed on the screened image data for 
respective CMYK plates. 

The method of descreening is also disclosed, for example, in Japanese Patent 
Application Laid-Open No. 2000-224415. Although performing the process based on 

10 the shapes of individual halftone dots, this method performs the descreening process 
without consideration of how pixels (referred to hereinafter as picture-originated 
(derived) pixels) constituting the first region are arranged in the layout data yet to be 
binarized in the RIP process. This might cause the creation of picture-originated pixels 
differing in arrangement from those in the original layout data, depending on the result of 

15 the descreening process. 

SUMMARY OF THE INVENTION 

The present invention is intended for a method of and a device for performing a 
descreening process for separating a screened image in the form of binary data generated 
20 from an original image into a first region from which a gradation area is to be derived and 
a second region from which a monotone area is to be derived, to selectively convert the 
first region into a multi-level gradation image. 

According to the present invention, a method of descreening a screened image 
comprises the steps of: (a) detecting the position of each halftone dot forming the 
25 screened image; (b) detecting from the screened image an arrangement of 
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picture-originated pixels in a gradation area of an image from which the screened image 
is generated; and (c) generating layout data having multi-level gradation from the 
screened image, the step (c) including the steps of (c-1) bringing predetermined threshold 
values into correspondence with individual recorder grids constituting each halftone cell 
5 determined in the step (a), and (c-2) setting gradation levels in the gradation area for 
descreened layout data, the gradation levels in the gradation area being set based on a 
correspondence between the predetermined threshold values and whether or not the 
recorder grids present in the position of each of the picture-originated pixels contribute to 
halftone dot formation. 

10 This method performs the descreening process based on information about the 

arrangement of the picture-originated pixels in the image from which the screened image 
is generated, to improve the reproducibility of the image from which the screened image 
is generated, thereby preventing the degradation of image quality. 

Preferably, the descreening method according to the present invention further 

15 comprises the steps of (d) separating a first region from which the gradation area is to be 
derived and a second region from which a monotone area is to be derived from each other 
by using a separation mask, and (e) specifying inconsistent recorder grids forming each 
halftone dot and having a contradiction between a result of an assumption that 
binarization is performed using the threshold values brought into correspondence in the 

20 step (c-1) and an actual state of binarization, to correct the separation mask based on a 
positional relationship between the inconsistent recorder grids in each halftone cell. The 
descreening is performed only on the first region. 

The descreening process is performed on other than the second region in which 
layout has been done at an output resolution level, whereby the efficiency of the process 

25 is improved. The method is capable of correcting the separation mask at the recorder 
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grid level to separate the second region more precisely. This improves the 
reproducibility of the image from which the screened image is generated in the 
descreening process to prevent the degradation of image quality. 

It is therefore an object of the present invention to provide a method of and a 
5 device for performing a descreening process on a screened image data containing both a 
picture image and a character/line with high accuracy without degradation of image 
quality. 

These and other objects, features, aspects and advantages of the present 
invention will become more apparent from the following detailed description of the 
10 present invention when taken in conjunction with the accompanying drawings. 



BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a schematic diagram of an image processing device according to the 
present invention; 

15 Fig. 2 is a diagram for illustrating functions implemented in a control section of 

the image processing device; 

Fig. 3 is a flowchart showing process steps performed in the image processing 

device; 

Fig. 4 is a schematic data flow diagram to the generation of layout data in a 
20 descreening process; 

Figs. 5A and 5B illustrate the process of judging to which region individual 
halftone dots belong; 

Figs. 6 and 7 illustrate a halftone dot position detection process for a first region 
from which a gradation area is to be derived; 
25 Figs. 8, 9A and 9B illustrate the detection of a boundary between two first 



regions having different dot percentages; 

Figs. lOA, lOB, IOC and lOD illustrate a screening process; 
Fig. 11 illustrates the descreening process; 

Fig. 12 is a flowchart showing the process of estimating gradation levels for 
picture-originated pixels; 

Fig. 13 shows a picture-originated pixel in which inconsistent recorder grids 

arise; 

Fig. 14 shows an example of the result of estimation of a second region from 
which a monotone area is to be derived in the picture-originated pixel having inconsistent 
recorder grids; 

Fig. 15 is a view illustrating the background art; 

Fig. 16 is a flowchart showing the process of judging whether or not a 
separation mask requires correction; and 

Fig. 17 is a view illustrating areas for summation during halftone dot position 

detection. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 
<Device Construction> 

Fig. 1 is a schematic diagram of an image processing device 1 according to a 
preferred embodiment of the present invention. The image processing device 1 
generates a separation mask for separating screened image data into a first region from 
which a gradation area is to be derived and a second region from which a monotone area 
is to be derived, and then performs a region separation process for correcting the 
separation mask at an output resolution level to separate the first region from the screened 
image data. In parallel with the region separation process, the image processing device 



8 

1 performs a descreening process for generating multi-level gradation data from the first 
region. Thereafter, the image processing device 1 performs a screening process for 
generating screened image data from the multi-level gradation data. In this preferred 
embodiment, the concept of "character" includes a numeric character. 
5 The image processing device 1 is connected to a media reader/writer 2 

including, for example, an MO drive or a CD-R/RW drive for reading various print data 
such as screened image data from various portable recording media such as an MO 
(magneto-optical) disk or a CD-R/RW disk, to an image scanner 3 for scanning a prepress 
film to directly generate the screened image data, and to an output device 4, such as a 

10 digital printing machine, which receives the screened image data to be outputted from the 
image processing device 1 to provide a predetermined output based on the screened image 
data. That is, the media reader/writer 2 and the image scanner 3 correspond to data input 
devices for the image processing device 1. Additionally, the image processing device 1 
may be capable of receiving print data or the like directly from other devices through a 

15 network (not shown) connected to a communication section 9 to be described later. 

The image processing device 1 is implemented by a computer. Specifically, 
the image processing device 1 principally comprises: a manipulation section 5 including a 
mouse and a keyboard for inputting various commands by an operator; a display section 6 
such as a display device; a storage section 7 including a hard disk for storing a program 

20 7p for causing the computer to function as the image processing device 1 and the like; an 
R/W section 8 for reading and writing data from and to various portable recording media 
via the media reader/writer 2; the communication section 9 serving as an interface for 
transferring data to and from other connected devices and devices on the network (not 
shown) through signal lines or by radio transmission; and a control section 10 including a 

25 CPU 10a, a ROM 10b and a RAM 10c for implementing functions to be described later. 
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In the image processing device 1, a so-called GUI (Graphical User Interface) 
capable of processing while displaying the details of manipulation through the 
manipulation section 5 and the current status of various processes on the display section 6 
is implemented by the functions of the control section 10, the manipulation section 5 and 
5 the display section 6. Processes in respective components to be described later which 
are implemented in the control section 10 are also carried out using the GUI. 

Fig. 2 is a diagram for illustrating the functions implemented in the control 
section 10 of the image processing device 1. 

The predetermined program 7p stored in the storage section 7 is executed by the 
10 CPU 10a, the ROM 10b and the RAM 10c to cause a mask processor 20, a halftone dot 
processor 30, an image conversion processor 40 and an image adjustment processor 50 to 
be principally implemented in the control section 10. 

The mask processor 20 is principally responsible for processes relating to the 
separation and combination (recombination) of the first region and the second region. 
15 To this end, the mask processor 20 includes a region separation section 21, a labeling 
section 22, and a region combination section 23. 

The region separation section 21 is responsible for the process of judging 
whether individual halftone dots are present in the first region or in the second region, 
thereby to generate separation mask data DM serving as a separation mask for extracting 
20 the first region. The process performed in the region separation section 21 is 
implemented, for example, by using the known technique disclosed in Japanese Patent 
Application Laid-Open No. 2002-252756. Thus, the region separation section 21 serves 
as an element for acquiring the separation mask. 

When a screened image contains a plurality of first regions, the labeling section 
25 22 is responsible for the process of labeling the plurality of first regions, i.e., masks 
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corresponding to the respective first regions. A variety of known labeling methods are 
applicable to the labeling process. One of such labeling methods is disclosed, for 
example, in Japanese Patent Application Laid-Open No. 1-302475 (1989). 

The region combination section 23 is responsible for the process of combining 
5 screened image data about the first region subjected to the separation process by the 
separation mask, the subsequent descreening process, the correction process, and the 
screening process again in the order named, with screened image data about the second 
region remaining the same as it was prior to the separation process, to generate single new 
screened image data. 

10 The halftone dot processor 30 is responsible for processes required to obtain 

position information about individual halftone dots and position information about the 
first region in a coordinate system using a recorder grid as a unit, the position information 
being required for the process of correcting the separation mask data DM. The position 
information about individual halftone dots and position information about the first region 

15 are also used to perform the descreening process on the screened image data about the 
first region. To this end, the halftone dot processor 30 includes a halftone dot position 
detection section 31, a picture-originated pixel arrangement detection section 32, and a 
mask correction section 33. 

The halftone dot position detection section 31 is responsible for the process of 

20 detecting the screen angle, screen ruling and halftone dot coordinate values of a screened 
image formed by the screened image data. This preferred embodiment is characteristic 
in that these pieces of information are detected based on a change in spacing between 
halftone dots which is obtained by observing the screened image in one direction while 
theoretically rotating the screened image. 

25 The picture-originated pixel arrangement detection section 32 is responsible for 
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the process of detecting the arrangement of picture-originated pixels in layout data from 
which the screened image is generated, based on the shapes of halftone dots positioned on 
a boundary between the first region and the second region or on a boundary between 
individual first regions in the screened image formed by the screened image data. This 
5 preferred embodiment is characteristic in that the picture-originated pixel arrangement 
detection section 32 includes an edge extraction section 321 for extracting the edges of 
halftone dots, and gives attention to a gradation level change characteristic of the 
boundary between different regions, thereby to precisely specify the arrangement of the 
picture-originated pixels on the order of recorder grids or at the output resolution level. 

10 The mask correction section 33 is responsible for a correction process for 

making the separation mask temporarily established in the region separation section 21 
more precise. Although effective for rough separation of regions, the process performed 
in the region separation section 21 cannot necessarily precisely specify the boundary 
between the first and second regions. For this reason, this preferred embodiment 

15 performs the process of correcting the separation mask under the action of the mask 
correction section 33 through the use of the presence of inconsistent recorder grids to be 
described later, to accomplish the separation of regions as precise as at the output 
resolution level. 

The image conversion processor 40 performs the descreening process for 
20 converting the screened image data about the first region into multi-level gradation data to 
generate new layout data while judging whether or not the separation mask data DM 
temporarily generated in the mask processor 20 precisely separates the regions, that is, 
requires correction. The image conversion processor 40 also performs the screening 
process for converting the layout data which is the multi-level gradation data into 
25 screened image data, in inverse relation to the descreening process. The image 
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conversion processor 40 includes a descreening section 41 and a screening section 42 in 
corresponding relation to the descreening and screening processes. The descreening 
section 41 includes a threshold value setting section 411 for bringing predetermined 
threshold value data to be applied in the screening process into correspondence with 
5 halftone cells determined by the detection of the halftone dot positions in the halftone dot 
position detection section 31, and a gradation level setting section 412 for setting a 
gradation level in the gradation area to be possessed by each of the picture-originated 
pixels generated by the descreening process, based on the positions of the halftone dots 
and the arrangement of the picture-originated pixels detected by the picture-originated 

10 pixel arrangement detection section 32. In this preferred embodiment, since the 
descreening process is performed using the information required for the judgment as to 
whether or not the separation mask data DM requires correction, the gradation level 
setting section 412 also serves as a judging element for judging whether or not the 
separation mask data DM requires correction. 

15 The image adjustment processor 50 is responsible for various adjustment and 

correction processes for a picture image represented by the multi-level gradation data. 
Thus, the processes of changing the color and density of the picture image and correcting 
the tone curve and gray balance thereof are implemented by the function of the image 
adjustment processor 50. 

20 

<Generation of Separation Mask> 

The details of the processes in the respective sections implemented in the 
control section 10 will be described one by one in accordance with the procedure. Fig. 3 
is a flowchart showing the processes in the image processing device 1. Fig. 4 is a 
25 schematic data flow diagram to the generation of the layout data in the descreening 
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process. 

First, screened image data Dl to be subjected to the descreening process is read 
from the storage section 7 or from a predetermined recording medium inserted in the 
media reader/writer 2 (in Step SI). Alternatively, the image processing device 1 may be 
5 adapted to generate the screened image data Dl directly from a prepress film scanned by 
the image scanner 3. When handling a color printed material, the image processing 
device 1 processes a plurality of screened image data for respective colors of CMYK. 
Since the processes for the plurality of screened image data are similar to each other, the 
process for the single screened image data Dl will be described hereinafter. 

10 After the screened image data Dl is read, the generation of the separation mask 

and the labeling are carried out under the action of the region separation section 21 and 
the labeling section 22 (in Step S2). These processes will be briefly described because 
the known technique is used for the processes as described above. 

Figs. 5A and 5B illustrate the process of judging whether individual halftone 

15 dots belong to the first region or to the second region during the region separation in the 
region separation section 21. Fig. 5 A schematically shows a distribution of halftone dots 
having approximately equal dot percentages in the first region SR. Fig. 5B 
schematically shows a linear line represented by halftone dots in the second region CR. 
During the region separation, the gradation level of a recorder grid is defined as "255" 

20 when the recorder grid forms a screened image, and is defined as "0" when the recorder 
grid forms no screened image, for purposes of convenience. A reference character PE 
designates an objective recorder grid to be judged, and El to E4 designate four recorder 
grids present in positions displaced respective vectors VI to V4 from the objective 
recorder grid PE, the vectors VI to V4 being determined from the screen ruling and the 

25 screen angle. To which region the objective recorder grid PE belongs is judged based on 
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a comparison between the sum RV of values Val to Va4, divided by four, and a 
predetermined threshold value Vs (e.g., Vs = 128), where the values Val to Va4 are the 
absolute values of differences (absolute differences) between the gradation level of the 
objective recorder grid PE and the gradation levels of the four recorder grids El to E4, 
5 respectively. The screen ruling and screen angle used herein may be those calculated in 
the halftone dot position detection process to be described later, in which case the process 
in Step S3 to be described below is performed on the entire screened image data at the 
same time. 

As shown in Fig. 5 A, the objective recorder grid PE and the four adjacent 

10 recorder grids El to E4 have approximately equal gradation levels in the first region SR 
containing a succession of halftone dots representing approximately equal median 
gradation levels. Therefore, the absolute differences Val to Va4 are small (ideally, the 
absolute differences equal zero), and the sum RV is accordingly small. Thus, there is a 
high probability that the objective recorder grid PE is within the first region SR, when the 

15 sum RV is less than the threshold value. 

As shown in Fig. 5B, on the other hand, a line is present locally in many cases 
to provide a nonuniform distribution of gradation levels in the second region CR. 
Therefore, the gradation level of the objective recorder grid PE often significantly differs 
from the gradation levels of the four adjacent recorder grids El to E4, and the sum RV of 

20 the absolute differences is accordingly large. Thus, there is a high possibility that the 
objective recorder grid PE is within the second region CR, when the sum RV is large. 

Based on such principles, a judgment is made as to whether each of the recorder 
grids is present within the first region or within the second region. Adjusting the setting 
of the threshold value enables discrimination between a plurality of first regions. As a 

25 result, position information data about all of the recorder grids judged to be within the 
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first region(s) is the separation mask data DM. 

The method of generating the separation mask data DM is not limited to that 
described above. For example, the separation mask data DM may be generated by 
performing a predetermined shrinking process on the screened image data to specify the 
5 second region. 

The separation mask data DM thus obtained indicates only whether or not the 
recorder grids are contained in the first regions. The labeling process for attaching 
labels for discrimination between the first regions is subsequently carried out under the 
action of the labeling section 22. 

10 The labeling process is implemented by judging a succession of recorder grids 

judged to be present within the first regions. Specifically, a judgment is made as to 
whether or not each recorder grid constituting the screened image is in the same region (in 
the same first region or in the same second region) as its adjacent recorder grid. A new 
label is attached each time a new set of recorder grids judged to constitute the same first 

15 region in succession is detected, whereby all of the first regions are labeled. Labeling 
information thus established is added to the separation mask data DM. 

The separation mask is obtained by newly creating the separation mask in the 
above description. Instead, if the separation mask data is previously generated in 
corresponding relation to the screened image being processed, the separation mask data 

20 may be acquired by reading from the media reader/writer 2 and be subjected to 
subsequent processes. In this case, the media reader/writer 2 serves as an element for 
acquiring the separation mask. 



25 



<Detection of Halftone Dot Positions> 

After the separation mask is generated as described above, the halftone dot 
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positions are detected for each first region (in Step S3). It is assumed that N first regions 
(first to N-th regions) are present in the screened image. . 

Figs. 6 and 7 illustrate the halftone dot position detection process for an n-th 
region (n is an integer ranging from 1 to N) which is one of the first regions, in the 
5 halftone dot position detection section 31. 

In this preferred embodiment, the halftone dot position detection section 31 
carries out the process of sequentially summing up the gradation levels of all recorder 
grids in a projective manner in one direction while theoretically rotating the screened 
image, as schematically illustrated in Fig. 6. For purposes of illustration, summing 

10 directions are shown in Fig. 6 as rotated. It is assumed that the direction indicated by the 
arrow ARl is a direction representing the zero point (0 = 0^ ) of the rotation angle d of 
the screened image. The reference character CI denotes a count curve (count 
distribution) indicating a relationship between the count obtained by summing up the 
gradation levels in the direction indicated by the arrow ARl and the recorder grid position, 

15 and C2 denotes a count curve in the direction of 0 = 45** indicated by the arrow AR2. 

The areas subjected to the summation are determined to be equal in size without 
extending outwardly of the first regions when the summation process is performed in any 
summing direction. Fig. 17 illustrates such areas of the summation when the first region 
is rectangular in shape. For the first region PRO shown in Fig. 17, a measurement region 

20 MRl is subjected to the sunmiation process when the summation process is carried out in 
the direction represented by 0 -0"" , and a measurement region MR2 is subjected to the 
summation process when the summation process is carried out in the direction 
represented by 0 = 45"* . In this case, the measurement regions MRl and MR2 are 
determined so as to appear the same when rotated relative to each other. 

25 Performing the summation process on such measurement regions provides data 
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indicating a correspondence between the recorder grid position and the count (the sum of 
the gradation levels). The count curve is such a curve that a peak value is reached at a 
recorder grid position where the count is the highest, and the count at a recorder grid 
position not contributing to the formation of halftone dots equals zero. When the 
5 summation process is performed similarly while rotating the screened image, the shape of 
the count curve, i.e. the magnitude of peaks and spacings between the peaks, changes 
with the angle of rotation. The more uniform the spacings between the halftone dots in a 
direction perpendicular to the summing direction, the smaller a variation in count with 
respect to the recorder grid position, i.e. a difference between a maximum value and a 

10 minimum value. A summing direction such that the change in halftone dot spacing in a 
direction perpendicular to the summing direction is more significant results in a greater 
difference between a maximum value and a minimum value. Thus, the calculation of a 
change in count variations for the angle 0 allows the detection of a direction in which 
the halftone dots are spaced most closely, i.e., the screen angle 0s . In the case of the 

15 screened image shown in Fig. 6, the count curve CI varies little and the variation II is 
also small when 0=0°. For the screened image shown in Fig. 6, the variation 12 of the 
count curve C2 when 0 = 45° corresponds to the greatest variation in count. Therefore, 
the screen angle 0s is determined as 45° . 

The spacing between the peaks corresponding to maximum values of the count 

20 curve at the time that this screen angle is determined corresponds to the center-to-center 
spacing d of halftone dots. Therefore, the screen ruling L for the n-th region is 
calculated as the inverse of the center-to-center spacing d. 

In CMYK multicolor printing, a set of known values such as 0° , 15° , 45° 
and 75° are often used as the screen angle. Therefore, the image processing device 1 

25 may be adapted to determine the screen angle by making a comparison between the 
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changes in count for near these known screen angles in place of finding the changes in 
count for a given angle. 

After the screen angle ds and the screen ruling L are determined, the central 
position of each halftone dot is subsequently determined. Fig, 7 illustrates the 
5 determination of the central position of each halftone dot. 

A u-axis is defined to extend in a direction of the coordinate axis for indicating 
the recorder grid position or in a direction perpendicular to the summing direction at the 
time that the screen angle ds is determined. After the determination of the screen angle 
ds, the screened image is further rotated through 90° from the determined angle, and 

10 then the counts are calculated in the resultant direction as indicated by the arrow AR3. 
A v-axis is defined to extend in a direction perpendicular to the summing direction at this 
time. Then, the center of a halftone dot is positioned to satisfy both a peak position on 
the u-axis and a peak position on the v-axis. In other words, an intersection point of a 
pair of straight lines passing through the middles of peaks on the u- and v-axes, 

15 respectively, in a coordinate space defined by the u-axis as a horizontal axis and the 
v-axis as a vertical axis corresponds to the central position of one halftone dot. Thus, 
the coordinates of the central position of each halftone dot are determined as coordinates 
(u, v) in a u-v coordinate system. An affine transformation is performed to convert the 
coordinates (u, v) in the u-v coordinate system into an absolute coordinate system 

20 (referred to as an x-y coordinate system) determined independently of rotation, thereby 
providing the central position (x, y) of each halftone dot present in the first region 
accurately at the output resolution level. Further, a halftone cell USD (in Fig. 8) in the 
screened image data Dl is determined from the central position (x, y) of each halftone dot 
and the screen ruling L. Data about the halftone dot positions is referred to hereinafter 

25 as halftone dot position data D2. 
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<Detection of Arrangement of Picture-Originated Pixels> 

Next, description will be given on the process of detecting the arrangement of 
picture-originated pixels in the gradation area which is implemented under the action of 
5 the picture-originated pixel arrangement detection section 32, Figs. 8, 9A and 9B 
illustrate the detection of a boundary between two first regions having different dot 
percentages. Referring to Fig. 8, it is assumed that a region to the right of the boundary 
BD is the first region PRl containing halftone dots SDl having a dot percentage of 50%, 
and a region to the left of the boundary BD is the first region PR2 containing halftone 

10 dots SD2 having a dot percentage of 10%. Each of the rectangular regions enclosed by 
solid lines indicates the halftone cell USD corresponding to a halftone dot with a dot 
percentage of 100%. Each of the rectangular regions enclosed by dotted lines 
corresponds to a picture-originated (or picture-derived) pixel PPX conceivable in the first 
regions. Although picture-originated pixels PPX are conceivable both in the first 

15 regions PRl and PR2, the picture-originated pixels PPX in the latter are not shown for 
purposes of simplicity. 

The boundary BD between the first regions PRl and PR2 having different dot 
percentages is also a boundary between picture-originated pixels PPX. However, since 
the boundary between the picture-originated pixels PPX, in general, does not coincide 

20 with a boundary between halftone cells USD, there are cases where the boundary between 
the picture-originated pixels PPX lies within the halftone cells USD, as shown in Fig. 8. 
In such cases, a halftone dot SD3 lying on the boundary between the first regions, i.e., on 
the boundary between the picture-originated pixels PPX is shaped to consist of right-hand 
and left-hand halftone dot portions SD3R and SD3L joined together on the boundary BD. 

25 From another point of view, the halftone dots SDl and SD2 lying in the respective first 
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regions can be said to be deformed. With attention directed to this consideration, this 
preferred embodiment detects a junction between the halftone dots thus deformed to 
specify the boundary between the first regions, i.e. the boundary between the 
picture-originated pixels PPX, at the output resolution level, thereby specifying how the 
5 picture-originated pixels are arranged in the layout data yet to be screened. 

To detect the boundary BD in this preferred embodiment, the edge extraction 
section 321 acts to extract edges of the halftone dots constituting the screened image. A 
known edge extraction process, e.g. a Laplacian filter, is applicable to the screened image. 
This provides edge extraction data DE about the halftone dots SDl, SD2 and SD3 as 

10 shown in Fig. 9A from the screened image shown in Fig. 8. In this process, the 
gradation level of recorder grids corresponding to an edge is set at "1" and the gradation 
level of other recorder grids is set at "0." Next, the recorder grids containing edges are 
counted in a predetermined direction, based on the edge extraction data DE. 

Fig. 9B shows an edge count curve (count distribution) C3 indicating the result 

15 of counting in the direction of the arrow AR4 of Fig. 9A. As a result of such a counting 
process, the counts are approximately equal to each other in the first region PRl having 
the dot percentage of 50%. In the first region PR2 having the dot percentage of 10%, the 
edge count is zero where the halftone dots SD2 are absent, but the counts equal to those in 
the first region PRl is obtained where the halftone dots SD2 are present. On the other 

20 hand, since the halftone dots SD3 lying in the recorder grid position corresponding to the 
boundary BD are deformed as described above, the halftone dots SD3 have edges (i.e., a 
spikelike sharp peak is formed in terms of the count) on the boundary BD between the 
right-hand and left-hand portions SD3R and SD3L. As a result of the summation in the 
direction of the arrow AR4, the count where the halftone dots SD3 are present is 

25 significantly higher than those in the left-hand and right-hand first regions PRl and PR2. 
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In other words, the edge count curve C3 has a peak in a recorder gird position 
corresponding to the boundary between the picture-originated pixels belonging to 
different first regions. 

The above-mentioned process is carried out in two directions perpendicular to 
5 each other to provide respective pieces of peak position information, thereby detecting 
peaks corresponding to the boundary positions of the picture-originated pixels. Since 
the information about a multiplicity of boundaries are statistically obtained, the minimum 
spacing between the peak positions is presumed to correspond to the spacing between the 
picture-originated pixels, that is, the resolution. Therefore, how the original 
10 picture-originated pixels are arranged is presumed by dividing the screened image into 
sections having a size equal to the peak-to-peak spacing, based on the peaks 
corresponding to the high counts. 

Although the summing direction is shown as extending along the boundary BD 
between the first regions in Figs. 8, 9A and 9B for purposes of simplicity, there is in 
15 general no practical problems when the summing direction does not coincide with the 
direction extending along the boundary BD. Because the resolution of the 
picture-originated pixels PPX is lower than the output resolution, a plurality of adjacent 
, recorder grids almost always form a boundary. 

The execution of the above-mentioned process in two directions perpendicular 
20 to each other allows the precise grasp of the boundary between the first regions at the 
output resolution level as high as the halftone dot positions in the coordinate system 
represented on the order of recorder grids. Information about the boundary positions of 
the picture-originated pixels which is obtained by the picture-originated pixel position 
detection process is referred to hereinafter as picture-originated pixel position data D3. 

25 
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<Correction of Separation Mask and Descreening Process> 
The detection of the halftone dot positions and the detection of how the 
picture-originated pixels are arranged allow the positional relationship therebetween to be 
determined in a single coordinate system represented on the order of recorder grids. 
5 Referring again to Fig. 3, the high-precision correction of the separation mask (in Step 
S5) and the descreening process with image quality maintained (in Step S6) are 
subsequently carried out based on the halftone dot position data D2 and the 
picture-originated pixel position data D3. Although shown as performed independently 
for purposes of illustration, these processes in the respective steps are actually integrally 

10 performed. For ease of description, the screening process and the descreening process 
will be described first. 

Figs. lOA, lOB, IOC and lOD illustrate the screening process. For simplicity 
of discussion, it is assumed that a halftone cell USDl contains 10 x 10 = 100 recorder 
grids SPXl. It is also assumed that the halftone cell USDl corresponds to nine 

15 picture-originated pixels PPXl having the same gradation level, i.e., forming the same 
picture image, and contains no boundary between the first regions. 

The screening process is the process of providing a predetermined gradation 
level as a threshold value to each of the recorder grids SPXl constituting the halftone cell 
USDl, to construct a halftone dot using only recorder grids SPXl whose threshold values 

20 are less than the gradation level of the picture-originated pixels PPXl. Data about the 
threshold values established for the individual recorder grids of the halftone cell USDl is 
referred to as SPM data. A threshold value established for each of the recorder grids is 
referred to as an SPM value. Fig. lOA illustratively shows that the SPM data is 
established for the halftone cell USDl having the 100 recorder grids SPXl. Referring to 

25 Fig. lOA, the SPM values in ascending order are given to the recorder girds SPXl, 
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Starting from a recorder grid lying in the center so that the single halftone cell USDl can 
represent 101 levels of gradation. 

Figs. lOB, IOC and lOD show the results of the screening process, that is, 
halftone dots SDll, SD12 and SD13 formed in the halftone cell USDl when the 
5 gradation levels of the picture-originated pixels PPXl are 12, 40 and 70, respectively. 
The halftone dot SDll shown in Fig. lOB is composed of only recorder grids SPXl 
having SPM values of not greater than 11 because the gradation level in the gradation 
area is 12. The increase in gradation level in the gradation area as shown in Figs. IOC 
and lOD increases the size of the halftone dot. Referring to Fig. lOD where the 
10 gradation level in the gradation area is 70, adjacent halftone dots are in contact with each 
other. 

As discussed above, the screening process uniquely determines the shape of the 
halftone dot formed in the halftone cell USD in the corresponding position, based on the 
gradation level given to the picture-originated pixels PPXl and the SPM data. 

15 The descreening process, on the other hand, is basically in inverse relation to 

the above-mentioned screening process. In this preferred embodiment, the halftone dot 
positions and the picture-originated pixel positions are precisely detected in the 
coordinate system represented on the order of recorder grids, and the correspondence 
therebetween is exactly determined at the output resolution level. Therefore, this 

20 preferred embodiment can carry out this inverse process more precisely than the 
background art techniques. 

Fig. 11 illustrates the descreening process implemented under the action of the 
descreening section 41. For simplicity of discussion, it is assumed that the halftone dots 
present in the range shown in Fig. 11 have the same dot percentage, and there is no 

25 boundaries between the picture-originated pixels. In Fig. 11, the x-axis is defined to 
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extend in the horizontal direction of the recorder grids, and the y-axis is defined to extend 
in the vertical direction thereof. It is also assumed that a halftone cell USD2 containing 
10 X 10 = 100 recorder grids is positioned in the range represented by (x, y) = (k, 1) to 
(k+9, 1+9), and a picture-originated pixel PPX2 corresponding to 4 x 4 = 16 recorder 
5 grids is positioned in the range represented by (x, y) = (k+2, 1+4) to (k+5, 1+7). The 
former is determined under the action of the halftone dot position detection section 31, 
and the latter is determined under the action of the picture-originated pixel arrangement 
detection section 32. 

The descreening process in this preferred embodiment is the process of judging 

10 how the recorder grids constituting a single picture-originated pixel contribute to the 
formation of the halftone dots, based on the SPM data, after the determination of the 
arrangement of the halftone dots and the picture-originated pixels, thereby to estimate the 
gradation level originally possessed by the single picture-originated pixel based on the 
result of judgment. In particular, since this preferred embodiment specifies the halftone 

15 dot positions with high accuracy, the threshold value setting section 411 can apply the 
SPM data to the halftone cells in a manner similar to the screening process. 
Additionally, since this preferred embodiment detects the arrangement of the 
picture-originated pixels in the original layout data with high accuracy, the gradation level 
setting section 412 can substantially faithfully perform the inverse process of the original 

20 screening process. A state in which a recorder grid actually forms a halftone dot is 
referred to hereinafter as an "ON-state" and a state in which a recorder grid does not form 
a halftone dot is referred to as an "OFF-state." In Fig. 11, the shaded recorder grids are 
in the ON-state, and other recorder grids are in the OFF-state. 

The determination of the halftone dot position data D2 causes the threshold 

25 value setting section 411 to bring a halftone cell for use in formation of the halftone dot 
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into correspondence with the SPM data for formation of the halftone dot. In other words, 
the recorder grids in the halftone cell and the SPM values are brought into one-to-one 
correspondence with each other. 

The screened image in the first region is formed by reproducing the gradation 
5 levels originally possessed by the picture-originated pixels with low resolution by the use 
of the halftone dots each composed of a set of recorder grids with higher resolution. 
This allows the estimation of the gradation level represented by each halftone dot from 
the correspondence between the ON/OFF state of the recorder grids included in the 
picture-originated pixels and the SPM values given to the respective recorder grids. 

10 Fig, 12 is a flowchart showing the process of estimating the gradation level for 

each picture-originated pixel, which is performed in the gradation level setting section 
412. The process shown in Fig. 12 includes the process of judging whether or not the 
separation mask data DM requires correction. It is now assumed that the minimum and 
maximum possible values of the gradation level PGL of the picture-originated pixels are 

15 "0" and "M" (where M is an integer), respectively. For purposes of simplicity, M = 100 
in Fig. 11. In this case, therefore, the dot percentage is equal to the gradation level in the 
gradation area. The maximum of the SPM values of the recorder grids in the ON-state is 
denoted by Tl and the minimum of the SPM values of the recorder grids in the OFF-state 
is denoted by T2. 

20 When all of the recorder grids in an objective picture-originated pixel are in the 

OFF-state (YES in Step Sll), the dot percentage of a corresponding halftone dot is at 
least less than the minimum T2 of the SPM values associated with the recorder grids 
contained in the objective picture-originated pixel, and there is a possibility that the dot 
percentage is 0%. Thus, the gradation level PGL is estimated to be within the range 

25 indicated in Step S12. As an example, all of the recorder grids contained in a 
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picture-originated pixel PPX6 shown in Fig. 11 are in the OFF-state, and T2 = 43. It is 
hence estimated that a halftone dot SD14 present in the halftone cell USD2 and the 
halftone dot present to the left thereof both corresponding to the picture-originated pixel 
PPX6 have a dot percentage of not greater than 42%. 
5 In this case, all of the recorder grids in the objective picture-originated pixel 

may be regarded as being included in the first region. It is therefore judged that there is 
no need to correct the separation mask. 

On the other hand, when all of the recorder grids in an objective 
picture-originated pixel are in the ON-state (YES in Step S13), the dot percentage of a 

10 corresponding halftone dot is at least not less than the maximum Tl of the SPM values 
associated with the recorder grids contained in the objective picture-originated pixel, and 
there is a possibility that the dot percentage is 100%. Thus, the gradation level PGL is 
estimated to be within the range indicated in Step S14. 

In this case, all of the recorder grids in the objective picture-originated pixel 

15 may also be regarded as being included in the first region. It is therefore judged that 
there is no need to correct the separation mask. 

When the above-mentioned conditions are not satisfied or when some of the 
recorder grids constituting a picture-originated pixel are in the ON-state and others in the 
OFF-state (NO in Step Sll and NO in Step S13), a judgment is made as to whether or not 

20 the relation indicated in Step S15 is satisfied. If the relation in Step S15 is satisfied 
(YES in Step S15), the gradation level always exists as a value of between Tl and (T2 - 
1) (in Step S16). For the picture-originated pixel PPX2 shown in Fig, 11 as an example, 
it is estimated that the gradation level PGL takes a value of between 27 and 34 because 
Tl = 27 and T2 = 35. Similarly, it is estimated that the gradation levels PGL of 

25 picture-originated pixels PPX3, PPX4 and PPX5 take a value of between 30 and 33, a 
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value of between 29 and 35 and a value of between 33 and 43, respectively. After the 
range of the gradation level which each picture-originated pixel can take is obtained, the 
gradation level is then specified based on the range. A simple method, for example, is to 
determine the median value in the range as the gradation level of the picture-originated 
5 pixel. In this method, the values of 30.5, 32.5, 32 and 38 are obtained for the 
picture-originated pixels PPX2 to PPX5, respectively. For the halftone dot SD14 shown 
in Fig. 11 which is a halftone dot corresponding to the gradation level PGL = 33 (or a 
halftone dot having a dot percentage of 33%), the estimation that the median value is 
equal to the gradation level will provide a substantially appropriate value because an error 
10 is about 5. 

The picture-originated pixels PPX2 to PPX5, which lie in the same halftone cell 
USD, should have the same gradation level if there is no boundary between the first 
regions. It is therefore estimated that a proper gradation level lies within a range 
common to the estimated ranges of the four picture-originated pixels PPX2 to PPX5. 

15 Since the value satisfying all of the estimated ranges of the four picture-originated pixels 
PPX2 to PPX5 is only 33, the estimated value of these picture-originated pixels PPX2 to 
PPX5 may be determined as 33. In this case, the actual value is equal to the estimated 
value. Thus considering the conditions of adjacent picture-originated pixels allows the 
more accurate estimation of the gradation level. 

20 In this case, all of the recorder grids in the objective picture-originated pixel 

may also be regarded as being included in the first region. It is therefore judged that 
there is no need to correct the separation mask. 

The method of estimating the gradation level is not limited to the 
above-mentioned method, but a variety of methods may be employed. 

25 A state in which the relation in Step S15 is not satisfied (NO in Step S15), on 
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the other hand, means that a situation actually impossible when halftone dots are formed 
in the first region has arisen. Fig. 13 illustrates the occurrence of such a situation. In 
Fig. 13, a picture-originated pixel PPX7 containing 7 x 7 = 49 recorder grids is shown 
as lying within a halftone cell USD3 containing 10 x 10 = 100 recorder grids. The 
5 picture-originated pixel PPX7 does not satisfy the relation in Step S15 because Tl = 68 
and T2 = 24, and hence is not applied to the condition in Step S16. This means that a 
contradiction has arisen between a result of the assumption that binarization is performed 
by the screening process using the SPM values brought into correspondence by the 
threshold value setting section 411 and a state of binarization in the actual screened 
10 image. 

Since some of the recorder grids constituting the picture-originated pixel PPX7 
are in the ON-state and others in the OFF-state, the gradation level should take a value of 
between Tl and T2 to represent only a picture image. However, this requirement is not 
satisfied in the situation of Fig. 13. It is hence judged that recorder grids constituting a 

15 character or a line are mixed into the recorder grids constituting the picture-originated 
pixel PPX7. In other words, the first region and the second region are not precisely 
separated from each other by the separation mask. In this case, it is therefore judged that 
the process of precisely separating the first and second regions from each other, that is, 
the correction process of the separation mask must be carried out to properly determine 

20 the gradation level. Then, the separation mask is corrected under the action of the mask 
correction section 33 based on the contradiction related to the SPM values lying between 
the recorder grids in the ON-state and the recorder grids in the OFF-state (in Step S17). 

In the situation shown in Fig. 13, recorder grids to be processed are recorder 
grids (referred to hereinafter as inconsistent ON-state recorder grids) in the ON-state and 

25 having an SPM value less than the minimum value T2, and recorder grids (referred to 
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hereinafter as inconsistent OFF-state recorder grids) in the OFF-state and having an SPM 
value greater than the maximum value Tl. Specifically, the inconsistent ON-state 
recorder grids include 13 recorder grids haying the gradation levels of 25, 26, 27, 29, 33, 
34, 36, 40, 44, 52, 53, 54 and 68, and the inconsistent OFF-state recorder grids include 10 
5 recorder grids having the gradation levels of 24, 28, 32, 25, 39, 43, 51, 55, 56 and 67. 

If the inconsistent ON-state recorder grids actually constitute a halftone dot of a 
picture image, the inconsistent OFF-state recorder grids lying in the same halftone cell 
USD3 and having a gradation level less than the maximum value Tl should essentially be 
in the ON-state. The fact that the inconsistent OFF-state recorder grids are nevertheless 

10 in the OFF-state means that the inconsistent ON-state recorder grids do not constitute the 
halftone dot of the picture image or do correspond to the recorder grids constituting a 
character or a line. Conversely, considering that the inconsistent OFF-state recorder 
grids constitute a halftone dot of a picture image only when the inconsistent ON-state 
recorder grids constitute the halftone dot, a location where the inconsistent ON-state and 

15 OFF-state recorder grids are in contact with each other will always be the boundary 
between a character/line and a picture image. In the situation shown in Fig. 13, the 
boundary between the first and second regions will lie between the inconsistent ON-state 
recorder grid having the SPM value of 27 and the inconsistent OFF-state recorder grid 
having the SPM value of 55 and between the inconsistent ON-state recorder grid having 

20 the SPM value of 36 and the inconsistent OFF-state recorder grid having the SPM value 
of 56. 

For each picture-originated pixel in which the contradiction occurs, the 
boundary between the inconsistent recorder grids detected by the above-mentioned 
judgment is subjected to interpolation, e.g. linear interpolation, as appropriate. This 
25 allows the separation of the first and second regions which has not yet been detected by 
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the use of only the separation mask. The boundary detection process based on the 
judgment on the inconsistent recorder grids corresponds to the separation mask correction 
process. 

Fig. 14 shows an example of the result of presumption of the second region in 
5 the situation of Fig. 13. It is presumed that a second region CRl (only the boundary of 
which is shown) overlaps the picture-originated pixel PPX7 in the situation of Fig. 13. 
Writing information about this overlap region into the separation mask data DM 
accomplishes the correction of the separation mask. 

Then, the process in Step Sll and its subsequent steps is carried out again on 
10 the recorder grids lying in other than the overlap region within the picture-originated pixel 
PPX7, that is, with the second region separated at the recorder grid level (or the output 
resolution level). In the example shown in Fig. 14, it is estimated that the gradation 
level of the picture-originated pixel PPX7 takes a value of between 20 and 23 because Tl 
= 20 and T2 = 24. Thus, the descreening process is carried out after the precise 
15 separation of the second region which lies within the picture-originated pixel and which 
has not been separated by the separation mask generated in Step S2. 

The gradation level is estimated for each picture-originated pixel lying in the 
first region, and this process is repeated for all of the n-th regions (in Step S7). This 
generates the layout data D4 about the picture image having multi-level gradation based 
20 on the result of estimation and the predetermined resolution, and the layout data D4 will 
be subjected to the subsequent process. 



25 



<Adjustment Process and Subsequent Processes> 

After the layout data D4 is generated as discussed above, the image adjustment 
processor 50 performs a necessary adjustment process including changes in color and 
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density of the picture image and the corrections of the tone curve and gray balance (in 
Step S8). After the necessary adjustment process, the screening process is carried out on 
the adjusted layout data under the action of the screening section 42 to generate the 
screened image data again, and the process of recombining the data about the separated 
5 second region with the data about the first region is subsequently carried out under the 
action of the region combination section 23 (in Step S9). 

The generated new screened image data is outputted as required from the output 
device 4 (in Step SIO). 

These processes are accomplished by the use of known techniques. 
10 The adjustment process and its subsequence processes are not essential in the 

present invention. For example, the layout data obtained by the descreening process 
may be diverted to the production of other printed materials. 



<Modifications> 

15 If the generation of the separation mask is not aimed at the descreening process, 

the descreening process in Step S6 of Fig. 3 and the subsequent processes are not 
essential. The gradation level setting section 412 or the judging element need not 
estimate the gradation level as shown in Fig. 12, but is required only to judge whether or 
not the separation mask requires correction. Thus, the process is simplified as compared 

20 with the flowchart of Fig. 12. Fig. 16 is a flowchart showing the process of judging 
whether or not this correction is required. 

Steps S21, S22 and S23 of Fig. 16 are identical with Steps Sll, S13 and S15 of 
Fig. 12. If the answers to Steps S21 to S23 are YES, it is judged that the separation 
mask data DM need not be corrected for an objective picture-originated pixel (in Step 

25 S24). Only if the answer to Step S23 is NO, the separation mask data DM is corrected 
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as described above based on the positional relation between the inconsistent recorder 
grids. Then, the corrected separation mask data DM will be subjected to the region 
separation process. 

While the invention has been described in detail, the foregoing description is in 
5 all aspects illustrative and not restrictive. It is understood that numerous other 
modifications and variations can be devised without departing from the scope of the 
invention. 



